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ABSTRACT 

The paper discusses the applications of “Dy- 
namic Scheduling” technique, which has been 
invented for the scheduling of Flexible Manu- 
facturing System, to two space related schedul- 
ing problems; operation scheduling of a future 
space transportation system, and resource al- 
location in a space system with limited re- 
sources such as space station or space shuttle. 

DYNAMIC SCHEDULING 

“Reactive Scheduling”, in which the next 
operation to be performed is decided only when 
it is required, using a certain heuristic schedul- 
ing rule, has been widely utilized in manufac- 
turing control or resource allocation of multi- 
processor system. It has been pointed in many 
literatures that by employing sophisticated 
scheduling rules (called “dispatching or rout- 
ing rules”), a schedule of some quality can eas- 
ily be obtained with quite little computational 
load. This method is quite robust to the var- 
ious changes and anomalies in the production 
lines, because the scheduling decisions are de- 
ferred until required. The weak point of this 
strategy is, however, that these rules only refer 
to local information for decision making, and 
so the performance of the generated schedule is 
sometimes much degraded in the global sense. 


In the field of manufacturing control, “Dy- 
namic Scheduling” has been proposed [l] to 
compensate for this shortcoming of the reac- 
tive scheduling. In this method, many schedul- 
ing rules are prepared beforehand, from which 
one is selected considering the instantaneous 
situations at each decision timing, such as ma- 
chine status, buffer contents or current pro- 
duction requirements. Therefore, the schedul- 
ing decisions reflect more global information, 
which results in uniformly good scheduling per- 
formance in any line status or production re- 
quirements. For this objective, knowledge is 
required that predicts which rule is the best 
in a certain instantaneous situation, and ma- 
chine learning has been utilized for acquiring 
such knowledge. For example, in [1], the re- 
lationships between the situation and the best 
rule is obtained in the form of decision trees. 

SCHEDULING OF 

SPACE TRANSPORTATION SYSTEM 
OTV Network and Its Scheduling 

“OTV Network” has been proposed [2] as 
the low-cost, next generation space transporta- 
tion infrastructure (Fig. 1). This system is based 
on the space fuel stations (3 in Fig. 1) and 
reusable OTVs (2 in Fig.l). The OTVs, drop- 
ping in at fuel stations for fuel supply on their 
way (C), carry out various missions such as 
satellite delivery (D), recovery or other satel- 
lite servicing. When one mission is completed, 
OTV nominally returns to the Low Earth Or- 
bit (E), gets refurbished and waits for the next 
mission. This concept is much alike the truck 
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Figure 1. Transportation scenario of OTV Network 

transportation system on the Earth such as 
trucks carry loads sometimes dropping in at 
gas stations. 

For this OTV Network to work effectively 
and especially with low cost, various opera- 
tions within the network must be thoughtfully 
scheduled so that the requirements as a trans- 
portation system (such as to deliver payloads 
by their due dates) can be satisfied while sup- 
pressing the total required cost as low as pos- 
sible. The scheduling items include which pay- 
load to carry next with which OTV, which 
fuel station to use, which transfer trajectory 
to take, or what the OTV should do when its 
current mission is finished, etc. The scheduler 
must also deal with various anomalies such as 
failures of certain elements of the network sys- 
tem, urgent missions or mission changes. 

Proposed Intelligent Scheduler 

To meet these requirements, we have de- 
veloped an intelligent scheduling system based 
on cooperation of distributed decision makers 
[3]. The decision making activities are assigned 
to several intelligent managers implemented in 
the computer, and they cooperatively perform 
decision making based on their own heuris- 
tic knowledge or the results of internal sim- 
ulations where their knowledge is insufficient. 
Principally, the schedule is made in a so called 
reactive scheduling fashion, that is, the net- 
work operations are simulated according to a 
time line, and at each decision point one deci- 


sion candidate is selected. The managers drive 
the lower level scheduler to predict future ef- 
fects of each decision candidate, and with this 
predicted performance data they can pin-point 
one best candidate at each decision point. Re- 
active scheduling method is employed at the 
lower level for quickly simulating the optimal 
decision sequence to obtain such performance 
data. 

Application of Dynamic Scheduling 

The dynamic scheduling is applied to the re- 
active scheduling part of the proposed schedul- 
ing system, and the relationships between the 
situation and the best rule are obtained by ma- 
chine learning using Neural Network with the 
back propagation algorithm. The employed 
Neural Network has three layers each of which 
has 18, 20, and 12 nodes. The data input into 
the input layer is a set of attributes represent- 
ing the instantaneous situation of the OTV 
Network at the decision timing (such as the 
number of waiting satellites at each station), 
and the output layer dictates the most suit- 
able decision rule from among 12 candidate 
scheduling rules (such as Minimum Slack Time 
Rule) which seem effective in deciding the next 
actions. For the back propagation learning, to- 
tal 3630 data as to “18 attributes vs. the best 
rule” are generated by searching for the best 
rules exhaustively in various situation settings 
of the OTV Network, which have been utilized 
as the teaching signal for the Neural Network. 

Some Simulation Results 

In order to evaluate the effects of the em- 
ployed scheduling architecture, the following 
three type schedulers are compared; 

Sch.l) Single level, reactive scheduler alone 
Sch.2) Proposed hierarchical scheduler with- 
out dynamic scheduling 
Sch.3) Proposed hierarchical scheduler with 
dynamic scheduling 

Table 1 summarizes the typical performance 
and required computation time for these sched- 
ulers. It indicates that by employing the hier- 


archical scheduling architecture, due date vi- 
olations can be mitigated without too much 
additional fuel consumption. In addition, dy- 
namic scheduling further improves the perfor- 
mance in both of tardiness and fuel consump- 
tion, and as a result the proposed scheduler 
can suppress the maximum and mean tardi- 


problem. Each task has its priority value, and 
the total scheduling performance is calculated 
by summing the priority values of the tasks to 
be completed within the fixed time. 

Table 2. Requirements and Constraints for Resource 
Allocation Problem 


ness as small as one sixth of the reactive sched- 
uler even with less fuel. The weak point of the 
proposed scheduler is its large computational 
load (about 10 times of the reactive scheduler 
case), but it can be said that the combinatorial 
explosion is suppressed to some extent. 

Table 1. Summary of Scheduling Performance 


Requirements: 

(for each task respectively) 

Starting Time 

(Specified for some tasks) 

Duration 

Time required for the task 

Man power 

Number of required crews for; 

- Type 1 

Continuous attendance required 

- Type 2 

Occasional absense allowed 

- Type 3 

Occasional attendance required 

Electric power 

Power required for the task 


Constraints: 


Time Limit 


Total time allowed 


Scheduler 

Sch.l 

Sch.2 

Sch.3 

Labor Hour 

A crew’s maximum labor hour/d ay 

Hierarchical Scheduling 

off 

on 

on 


Maximum hour of continuous work 

Reactive Scheduling Rule 

fixed 

fixed 

dyna. 

Sleep Hour 

A crew’s required sleeping hour/d ay 

Maximum Tardiness*) 

14.0 

4.4 

2.6 

Maximum power 

Max. daytime power to be utilized 

Mean Tardiness 

1.4 

0.58 

0.23 

Battery power 

Max. nighttime power to be utilized 

Number of Delayed Missions 

10 

9 

5 

Battery capacity 

Max. energy to be loaded 

Fuel Consumption 2 ^ 

215 

224 

202 



Computational Time 3 ) 

27 

259 

262 




Scheduling Strategies 


Note) 

1) “Tardiness” means delay from due date (days). 

2) Additional to the minimum requirement. 

3) Measured using a computer with 300 MIPS perfor- 
mance (sec). (Mission density: 30 missions in 80 days) 

RESOURCE ALLOCATION 
Resource Allocation Problem 


Three type scheduling strategies are com- 
pared; 

Sch.l) automatic scheduling using dynamic 
scheduling 

Sch.2) automatic scheduling using a fixed 
simple scheduling rule 

Sch.3) manual scheduling after some training 


Resorce allocation is a very important prob- 
lem especially in space, where the resource such 
as man power, electric power, water or tools 
are strictly limited and it is usually required 
that quite many tasks be performed within 
a limited time. The scheduling system must 
make the most of these limited recource to effi- 
ciently perform as many tasks as possible, and 
besides, in a case when a certain anomaly such 
as a malfunction of a certain tool or a degra- 
dation of power supply occurs, quickly remake 
the total schedule. In this case study, the dy- 
namic scheduling technique is applied to a cer- 
tain assumed resource allocation problem. Ta- 
ble 2 briefly describes the requirements given 
by the tasks and constraints in the assumed 


In both of Sch.l and Sch.2, scheduling is 
performed by iterating the process of picking 
up one task from the pool of tasks which have 
not been scheduled yet then placing the task in 
a certain position in the scheduling table and 
allotting the required resources according to 
a certain rule. During the training of manual 
scheduling, it has been found that the selection 
of the next task to be scheduled determines 
the scheduling performance. Considering this, 
Sch.l employs dynamic scheduling for this se- 
lection while Sch.2 utilizes a certain fixed rule. 
For the dynamic scheduling, 10 heuristic rules 
are prepared from which one is selected at each 
decision timing considering 22 attributes de- 
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scribing the situation at that timing. Exam- 
ples of the rules are “select the task with the 
highest priority value” or “select the task with 
the least duration time” and so on, and the 
attributes include “the rate of operation of the 
crews” or “the maximum time window during 
which one, two and three crews are available”, 
and so on. The relationships between the at- 
tributes and the best rules are acquired by the 
back propagation algorithm, using the data ob- 
tained by scheduling randomly generated small 
set of tasks with an exhaustive search strategy. 

Performance Comparisons 

Figure 2 and 3 describes the performance 
and required scheduling time of the three strate- 
gies and the exhaustive search result (i.e., op- 
timum solution). Three levels of complexity, 
1) 4 tasks in 150 minutes, 2) 6 tasks in 150 
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Figure 2. Performance of Three Scheduling Strategies 
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Figure 3. Required Computation Time 


minutes and 3) 6 more complex tasks in 200 
minutes are tried. Ten problems are generated 
randomly for each level, and maximum, aver- 
aged and minimum marks are calculated. It 
is observed that the fixed rule scheduling can 
generate schedule in quite a short time, but its 
performance is sometimes much degraded. On 
the other hand, the dynamic scheduling per- 
forms much better with slightly larger com- 
putational load, and the required time is still 
several orders less than the exhaustive search 
or manual scheduling. Moreover its computa- 
tional time and performance do not get much 
worse even for more complex problems. These 
results indicate the effectiveness of the dynamic 
scheduling for quickly generating an accept- 
able schedule. 

CONCLUSIONS 

Dynamic scheduling has been applied to two 
space related problems; the scheduling of space 
transportation system and the resource allo- 
cation in a space system. The simulation re- 
sults indicated that the dynamic scheduling 
can be effectively utilized as a sub-element of 
an overall scheduling system especially where 
the quick response is required, and that it will 
also provide an effective aid to an onboard 
rescheduling in case of some anomalies. 
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